Improving zero-error classical communication with entanglement 
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Given one or more uses of a classical channel, only a certain number of messages can be transmitted 
with zero probability of error. The study of this number and its asymptotic behaviour constitutes 
the field of classical zero-error information theory [T] [2], the quantum generalisation of which has 
started to develop recently [3H6]. We show that, given a single use of certain classical channels, 
entangled states of a system shared by the sender and receiver can be used to increase the number 
of (classical) messages which can be sent with no chance of error. In particular, we show how 
to construct such a channel based on any proof of the Kochen-Specker theorem [7]. This is a 
new example of the use of quantum effects to improve the performance of a classical task. We 
investigate the connection between this phenomenon and that of "pseudo-telepathy" games. The 
use of generalised non-signalling correlations to assist in this task is also considered. In this case, a 
particularly elegant theory results and, remarkably, it is sometimes possible to transmit information 
with zero-error using a channel with no unassisted zero-error capacity. 



PACS numbers: 03.67.Ac, 03.67.Bg, 89.70.Kn 

It is well known that if two parties share an entangled 
quantum state, they may be able to achieve tasks which 
would be otherwise impossible. For instance, without 
communicating they can violate Bell inequalities [8] , and 
with classical communication they can teleport the state 
of a quantum system [S]. Here we show that quantum 
effects can sometimes give an advantage in the context of 
zero-error coding [TJ [5] : A classical channel Af connects a 
sender (Alice) to a receiver (Bob) . It has a finite number 
of inputs and outputs and its behaviour is fully described 
by the conditional probability distribution over outputs 
given the input, i.e. it is discrete and memoryless. Given 
one use of Af, the maximum number of different messages 
Alice can send to Bob if there is to be no chance of an 
error is known as the one-shot zero-error capacity of J\f. 

The main contribution of this paper is to show that for 
certain classical channels, entanglement between Alice 
and Bob can be used to increase the one-shot zero-error 
capacity for classical messages. This is in contrast to 
interesting recent work considering zero-error coding for 
classical and quantum data over quantum channels [SHE] . 
Recall that the use of entanglement [TU] (and even non- 
signalling correlations cannot increase the transmis- 
sion rate if we only demand that the error rate goes to 
zero in the large block length limit: it remains equal to 
the normal Shannon capacity |12j . 

We briefly review classical zero-error coding, then we 
show how to construct classical channels where entangle- 
ment can increase the one-shot zero-error capacity. We 
then discuss the relationship of entanglement assisted 
zero-error coding to "pseudo-telepathy" games. After 
that, we upper bound this entanglement assistance by 
considering generalised non-signalling correlations, giv- 
ing a simple formula for the non-signalling assisted zero- 



error capacity of any channel. This turns out to have 
an interesting relationship to classical results of Shannon 
from his original paper £Q on zero-error capacities. 

Two input symbols of a channel are confusable if the 
corresponding distributions on output symbols overlap. 
Shannon introduced the confusability graph G{Af) of a 
classical channel Af: Its vertices are the set of input sym- 
bols and they are joined if and only if they are confusable. 
Classically, a zero-error code is a set of non-confusable in- 
puts. The one-shot zero-error capacity Co(Af) of a chan- 
nel Af is simply the maximum size of such a set. In the 
language of graph theory, a maximum non-confusable set 
of inputs is a maximum independent set of the confusabil- 
ity graph, and when Bob receives a channel output, the 
possible inputs are a clique in the confusability graph. A 
channel has no unassisted zero-error capacity if and only 
if its confusability graph is complete i.e. all vertices are 
connected. 

It is also useful to define the hypergraph of a channel: 
A hypergraph is just a set S (the vertices) and a set of 
subsets of S called the hyperedges. The hypergraph of 
a channel Af has the set of inputs as vertices and one 
hyperedge for each of the outputs, which contains all the 
inputs that have a non-zero probability of causing that 
output; we denote it H{Af). See Figure [l] for an example 
illustrating the confusability graph and channel hyper- 
graph. 

In this work we deal with correlations (bipartite condi- 
tional probability distributions) in the classes SR, SE and 
NS: Correlations belong to SR if and only if they can be 
obtained using (classical) Shared Randomness (and local 
operations); to SE (Shared Entanglement) if and only 
if they can be realised by local operations on a shared 
quantum state; and to NS if and only if the correlation is 
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FIG. 1: From left to right: The conditional probability matrix 
of a classical channel Af with inputs in {1, 2, 3, 4} and outputs 
in {a,b, c, d}; Its hypergraph H(AT), with the hyperedges la- 
belled by the corresponding outputs; Its confusability graph 
G(Af). From G(AT) it is easy to see that inputs 1 and 4 form 
a maximum non-confusable set (as do 2 and 4) so Co {Af) = 2. 



Non-Signalling (meaning that the marginal distribution 
on the output of each party is independent of the other 
party's input). Each class in this list strictly contains the 
previous one. We denote the maximum number of mes- 
sages which can be sent without error by a single use of 
Af when any correlation in class can be used by cq (Af) . 
The corresponding limiting rate to send zero-error bits is 
Cq(N) := lim^oo i log en (A/ -18 ™). A simple convexity 
argument shows that shared randomness between sender 
and receiver cannot help, so csr(AT) = c (Af) for all chan- 
nels. In constrast, we will next show how to construct 
channels Af for which the number of messages which can 
be sent perfectly using entanglement, cse (A/"), is greater 
than co(Af). 

Entanglement-assisted zero-error communication. 
Given a classical channel Af from Alice and Bob, with 
inputs X and outputs Y, how might they make use 
of entanglement to increase the number of messages 
which can be sent? Suppose that Alice wants to send 
one of q messages to Bob without error and that their 
entangled shared system is in state pab- She will 
perform some operations on her side of the entangled 
system, and conditioned on the outcomes of any classical 
measurements that she does, and on the message m 
that she wants to send, choose some input to Af. All 
of this can be represented by saying that she chooses 
one of q generalised measurements according to to, 
each with \X\ outcomes, to perform on her side of the 
state, and then uses the outcome k as input to Af. 
Since the residual state on Alice's side is irrelevant 
to Bob's ability to decode the message, the encoding 
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is fully specified by the POVMs {E\ 
to G [q] := {l,...,q} corresponding to the q different 
generalised measurements. 

If Alice sends message to, then with probability p^™\ 
Alice inputs k and the residual state of Bob's system is 
= (Tr A ® lp)M" l) m Letting ^ := p{ m \ 
for all messages to: Ylk^k = ^ t aPab ='■ Pb re- 
flecting the fact that without information from the 
classical channel, Bob has no idea which message 



Alice sent (i.e. causality). Conversely, any set of 
positive operators /?[ m '* which satisfy this condition 
for some ps can be realised by a suitable choice of 
Pab and generalised measurements. Now, including 
the state of the channel output (we label the system 
C) as well as his half of the entangled system, Bob's 
state after receiving the channel output y G Y is 

<J m ■= J2xex,yeY-^(y\ x )\y}(y\c ® M m) - The encoding 
works if and only if Bob can distinguish perfectly be- 
tween all the cr m , i.e. for all to, w! G [q]: = Tr <J m a m i — 

E X , X . £X confute (EyWvWivWj) ^ ^ ^ . 

We therefore have: 

Theorem 1. For any channel Af with inputs X and 
outputs Y, c S e(A0 = q(G(Af)), where q(G(Af)) is the 
maximum integer q such that there exists a density ma- 
trix pb and positive semidefinite operators for all 
to G [q\, x G X. on some Hilbert space such that for all 

m ' J2xex A* = PB, and 



Vto 7^ m! V confusable x,x' Tr/3^ m ^l3^T 
In particular, cse(jV) depends only on G(Af). 
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In light of this fact, it is clear that if a channel has no 
unassisted zero-error capacity then entanglement cannot 
change this. Otherwise, entanglement would allow per- 
fect communication over the completely noisy channel, 
in violation of causality! 

However, there are some channels, for which cse > 
c > 0. Examples of such channels can be constructed 
from proofs of the Kochen-Specker (KS) theorem [7]: We 
call a family {B m }^ =1 of complete orthogonal bases B m 
of C d a KS basis set if it is impossible to select one vector 
from each basis such that no two are orthogonal. That 
such sets exist is a corollary of the KS theorem [7]. 

Theorem 2. For any KS basis set Z = {B m } q m=l in 
C d consisting of q orthogonal bases, one can construct a 
classical channel Af with Co(Af) < q and cse (Af) > q. 

Proof. Let us write B m = {ip m i, • ■ • , tpmd}- We can con- 
struct a channel Afz with inputs in [q] x [d] such that a 
pair of inputs (to, j), (m',j') are confusable if and only 
if the corresponding vectors ip m j and ip m 'j' are orthogo- 
nal. (In general there are many ways to do this and any 
one will do. For instance, one can add an output symbol 
for each orthogonal pair which can be activated by both 
inputs in that pair but no others.) G(Af) has an edge be- 
tween inputs if and only if the corresponding vectors are 
orthogonal. As such, the vertices of G can be partitioned 
into q cliques of size d, corresponding to the q bases of Z , 
so the independence number of G is certainly no larger 
than q. If there was an independent set of size q in G it 
would have to have exactly one vertex in each of the q 
cliques, but this would select one vector in each of the q 
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1: (1,0,0,0) 2: (0,1.0,0) 3: (0,0.1,0) 4: (0,0, 0,1) 

5: (0,1, 1,0) 6 : (1,0,0, -1) 7: (1,0,0,1) 8 : (0, 1,-1,0) 

9 : (1,1,1,1) 10: (1,-1,1,-1) 11 : (1,-1,-1,1) 12 : (1,1,-1, -1) 

13 : (1,-1,0,0) 14: (1,1,0,0) 15 : (0, 0,1,1) 16 : (0, 0, 1, -1) 

17: (-1,1,1,1) 18: (1,1,1,-1) IS : (1,-1,1,1) 20 : (1,1,-1, 1) 

21: (1,0,1,0) 22: (0,1, 0,1) 23 : (1,0,-1,0) 24 : (0,1,0,-1) 

FIG. 2: A KS basis set of 6 bases for C 4 is tabulated at 
the bottom of the figure, one basis per row. The vectors are 
presented as 4-tuples labelled by a number. The diagram 
represents a channel Af with an input symbol for each vector 
in the set. It has an output symbol for each grey loop: on 
input x the output is drawn uniformly at random from those 
corresponding to the 3 loops which contain that x. Inputs are 
confusable if and only if corresponding vectors are orthogonal, 
so by Theorem 2, Co (Af) < 6 (in fact it is 5), but cse(A/") > 
6. It is interesting to note that to send one of 6 symbols 
(with equal prior probabilities) by a single use of Af, the best 
unassisted code has error probability 

bases such that no two are orthogonal, contradicting the 
assumption on Z. Therefore, cq(N) < q. 

To send q messages using entanglement, Alice and Bob 
can use a maximally entangled state of rank d: to send to, 
Alice measures her side of the state in the bases B m and 
obtains the outcome j (at random). She inputs (m,j) 
to the channel. Bob's output tells him that Alice's in- 
put was in some particular mutually confusable subset, 
but by construction, these inputs correspond to mutu- 
ally orthogonal residual states of his subsystem, so he 
can perform a projective measurement to determine pre- 
cisely which input Alice made to the classical channel, 
and hence which of the q messages she chose to send, 
with certainty. □ 

In Figure[2]we give an example of a KS basis set derived 
from a proof of the KS theorem due to Peres [13] . 

Relationship to pseudo-telepathy games. This increase 
of the one-shot zero error capacity is an example of 
performing a classical task without error using entan- 
glement, that becomes impossible without the entangle- 
ment. This phenomenon might sound familiar to those 
who have encountered 'pseudo-telepathy' games (here- 
after PT-games) jUj. The difference is that in these 



games Alice and Bob are not allowed to communicate 
with each other at all, but instead communicate with 
a verifier who sends them questions and then decides 
whether or not they win the game based on their replies. 

To be precise, in this context a 'game' g consists of 
questions a and b (drawn according to a fixed distribu- 
tion p(a, b)) to Alice and Bob respectively, who reply with 
answers a and /3. These are accepted with probability 
A(a, b, a,P), A also being a fixed distribution. The prob- 
ability of acceptance (a.k.a. 'winning') is given by 

fl( s ) : = ^2 A(a,b,a,f3)p(a,b)s(a,P\a,b), 

where the strategy s(r\q) is a correlation describing the 
responses r of the provers to questions q. Note that g(s) 
is a linear function of s. We call the strategy s 'perfect' 
(for the game g) if and only if g(s) = 1. Typically we 
are interested in the best winning probability which can 
be achieved if the strategy is restricted to some class of 
correlations like NS or SE. A PT-game is a game g which 
can be won with certainty by a strategy in SE but cannot 
be won with certainty by any strategy in SR. 

Proposition 3. For any channel Af with inputs X and 
outputs Y , and integer n, there exists a natural game g 
such that g has a perfect strategy in the class of correla- 
tions n if and only if cq > n. 

Proof. In the game g, the verifier sends Alice to G [n] 
and Bob y € Y drawn independently and uniformly at 
random. Alice sends back an answer x € X and Bob 
replies with to € [n]. If Af(y\x) > then they win the 
game if and only if to = to. Otherwise, they always win 
the game. A strategy s is perfect for this game if and only 
if J2 X y N(y\x)s(x, fh\m, y) — <5 TO m- Therefore, there is a 
perfect strategy for g in f2 if and only if Cq(jV) > m. □ 

This means that, in order to give an advantage for zero- 
error coding over SR, a correlation in SE must also be 
able to win a particular PT-game with certainty (and 
hence sit on the boundary of the non-signalling poly- 
tope). 

N on- signalling assisted zero-error capacity and exact 
simulation. While all correlations which can be realised 
by measurements on entangled states are non-signalling, 
the converse is not true, as in the case of the Popescu- 
Rohrlich box 15 . Consequently, we can study non- 
signalling assisted protocols to find upper bounds for 
entanglement assistance, but this study also leads to a 
beautifully simple theory of non-signalling assisted zero- 
error communication. 

Recalling the definition of a hypergraph, the fractional- 
packing number a* (H) of a hypergraph H |16j on vertices 
X is the maximum value of Ylxex v ( x ) where v : X —¥ 
[0, 1] weights the vertices subject to the constraint that 
for all hyperedges S of H , J2xeS v ( x ) — 



4 



Theorem 4. For a classical channel Af with hypergraph 
H(Af), 

c m (Af)=[a*(H(Af))\, 

where a*(H(Af)) is the fractional-packing number of 
H(Af). ^ ^ 

Furthermore, since the function a* is multiplicative, in 
the sense that a*{H{Af x ®Af 2 )) = a*(H(Afi))a*(H(Af 2 )), 
the NS-assisted zero-error capacity of Af is 

C NS (A0 = loga*(H(Af)), 

which is additive: C NS (A/i ®Af 2 ) = C N s(A/i) + C NS (Af 2 ). 

To get the best upper bounds on entanglement assisted 
zero-error communication using this result, we should 
minimise over all hypergraphs with the same confusabil- 
ity graph G as the channel in question, because cse de- 
pends only on G (see Theorem [lj. 

The proof of Theorem [4] is given in [TT] . With one 
interesting proviso, the non-signalling assisted zero-error 
capacity Cns(A0 is the same as the feedback-assisted 
zero-error capacity of the channel Cof(A/"), as derived 
by Shannon in his seminal paper pQ. The proviso ap- 
plies only when the unassisted zero-error capacity is zero: 
Then Cns can be positive, whereas Cof is always zero. 
We will now give a simple example of this. Let Af be the 
classical channel which takes as input j an element of the 
set A — {1,2,3, 4}, and outputs a 2-element subset of A 
which contains j. Since any two inputs of this channel 
can be confused (i.e. can lead to the same output), it has 
no unassisted zero-error capacity. 

We now exhibit a bipartite correlation P(x, y\a, b) that 
can be used to boost the zero error capacity of Af to one 
bit: Alice's input a is a bit and Bob's input b is a 2- 
element subset of A. Alice's output x is an element of 
A, drawn uniformly at random (independently of cither 
input); if x € 6 then Bob's output y is set to a, otherwise 
it is set to NOT(a). Clearly, the marginal distribution 
of Bob's output is independent of Alice's input and vice 
versa, so P is non-signalling. 

Now, suppose Alice plugs her output of P into the 
channel Af and Bob uses the output of Af as his input b 
to P. Given the behaviour of Af this forces b to contain x, 
therefore Bob's output y will always be equal to a. A bit 
is transmitted from Alice to Bob with perfect reliability! 

Channel simulation and reversibility. One can also 
consider the 'reverse' problem to zero-error coding 
and ask what is the minimum identity channel needed, 
given correlations in f2, to simulate one (or more) uses 
of some noisy channel Af exactly (in the sense of exactly 
reproducing the conditional probability distribution of 
outputs given inputs). We denote this minimum required 
number of messages by kfi(Af), and the Q-assisted simu- 
lation cost of Af by Kn(Af) := lim^oo \ \ogk^{M® n ). 



Again, the structure of the set of all non-signalling corre- 
lations results in a very simple formula for k-^s(Af): For 
any channel Af with inputs X and outputs Y, k^s{Af) = 

^2 rnaxj Af(y\x) , and since the sum here is multi- 
plicative under tensor products of the channel matrix, 

K m (Af) = log (j2 y ™xxN(y\x)) ■ 

While we have found examples showing an arbitrar- 
ily large gap between /cns(A0 and fcsR.(A0, the gap dis- 
appears in the limit of many channel uses: KgR(Af) = 
K SE (Af) = K m (Af) mi- 

Curiously, a kind of combinatorial zero-error reversibil- 
ity exists when non-signalling correlations are freely 
available: For a given channel hypergraph H, the NS- 
assisted zero-error capacity of channels with hypergraph 
H is equal to the infimum of the NS-assisted simulation 
cost for channels with hypergraph H [llj . in analogy to 
the direct and reverse Shannon theorems jTQl H2] . 

Conclusion. We have shown that entanglement can 
sometimes be used to increase the number of classical 
messages which can be sent perfectly over classical chan- 
nels. To upper bound this quantum advantage, we have 
given a simple formula for the non-signalling assisted ca- 
pacity as a linear program. These discoveries present 
many new questions: Firstly, can entanglement improve 
the asymptotic zero-error capacity, compared to no assis- 
tance, as we have seen NS correlations can? More gener- 
ally, can we find a simple expression for the entanglement 
assisted zero-error capacity in the one shot or asymp- 
totic case? Note that while the best general upper bound 
known on Co is given by Lovasz' famous function [17] . 
it was very recently found (indeed prompted by our The- 
orem [2]) that fl is still an upper bound on Cse [HI US] • 
Can we find simpler, less contrived, examples of channels 
where cse > Co? In another direction, the relationship 
between BKS theorems and PT-games has been studied 
in 20J . We found connections between the entanglement 
assisted zero-error phenomenon and both of these topics, 
but left open the development of a fuller understanding 
of the relationships among the three. 
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